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ABSTRACT . * 

' .^any consider the use of adjunct questions 

(mathemagenics) to be a means by which the instructional value of " a 
text tan be increased with relatively little difficulty, and this 
explains the appeal they have generated over the years. Yet this 
appeal is seldom tempered by a consideration of the ecological 
validity of the experimental studies on which the theoretical 
foundation of mathemagenics is based. The issue is whether the 
research evidence for enhanced learning that is obtained in 
controlled studies can be extrapolated to practical instructional 
settings. It is mainly the effects of postquest ions ' that create the 
most x interest, -*>for&it is they which enhance .both relevant 
(quest ion^rejfced-) learning and incidental (unrelated) learning, as 
seen oj| a posttest. In experimental studies, the students cannot turn 
back to" seek out or check the answer -to the question they have just 
encountered. Their only option is mental review, which is a far 
"different situation than the one encountered in practical settings 
where students study freely with the ir' textbooks . Experimental 
constraints also encourage students to process the text in ways that 
are an exaggeration of their natural techniques. Thus, both mental 
review and the general' stimulatory effect of postquestions are 
confounded by procedural tactics. ? The procedural paradigm currently 
employed in ma'themagenic .research will not provide useful and 
practical Results. That "postquestions do- enhance learning in real 
study settings is, generally, recognized. However, how they do it and 
how questions can be best used remains to be established. (HO*jju) 
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Adjunct Questions Effects V 
and Experimental Constraints 

4 • 

Narrow theories that deal only with artificially \* 

♦ 

v limited data sets $re of no interest, however • ^ 

* * parsimonious 4hey may be^ if it qan be shown* * * 
.that they are insufficient to deal with the 

4 . 

genera I problem, t 

- • 

* " Kintsch (197 2 *, p. 201) 

} * * 

- . Ever since Rpthkopf" Stimulated Interest fn„ the possibijity of enhancing 
prose materials thrbugli the. use of adjunct questions (Rothkopf, 1965),*the 
research in this particular, area .of instructional psychology has grown phen- ' 
omen'ally. Interest in the field of education seems 'high, "as evidenced by the. 
growing number of reviews devoted to this topic in the literature. # Mathemage'nics 
furthermore, are entering the educational psychology, textbooks , at Least in 
theory ^ if jiot yet very-oftep in practice. 1 \ * *" * ' 

Mathemagenics are usually thought of as means by\hich the instructional^ 
value of a text can.be increased with relatively little difficulty and this, 
indeed, would explain the appeal they h^ve generated over the years. Yet this 
appeal is all too seldomly tempered ; it would seem, by a consideration of the 
ecological* validity pf the experimental studies on which' the theoretical founda- 
tion of mathemagenics is based. / . . , 

The issue Is an important one for educational practice: 0 can the 'research 
evidence for enhanced learning which is obt^Wu i n, control led studies be extra- , 
po la ted to practical instructional settings? What mgst .be considered is whether 
the experimental task constraints employed in the control led studies mirror the 
constraints operating in real-life settings. It is the intent' of this paper, to- 



discuss this issueand to ar§ue -that a^practital case for certain mathemagen i c 
effects remains to be made. It is not its Intent, however, to offer yet another ' 
f •detailed review of the literature in this area. 

^ Procedural 'Constraints * , 

The adjunct question paradigm is a well-established one: questions are 

• interspersed throughout a prose passage or short text in one of two positions: 
either close before j:he text materjaj to which they relate or shortly after that' 
material. It is'mainly the effects of postquestions whi'ch create the most interest, 
for, it is they which enhance both relevant (question-related) learning and inci- 
dental (unrelated) learning, as leen on a' posttest. What is .of concern to us. here 
is the procedural^paradigm which pervades this research area/ This- is as follows: 
the students participating in the study read the prose passage page by page^unti 1 

m they encounter V postques.t ion, which is placed on a separate pagg; af ter'attempting * 

to mental ly. answer the question, they then proceed to a "'further segment qf text 

and so on. The inportant procedural point which sets these experimental studies 
« • * < 

4 apart from their corresponding pract icak context is that physical review of the 

' - 

text is not permitted. " In other words, the students cannot turn back to seek out 

' f- 

or check the answer to< the question they have just .encountered. Their only option 

is mental review. - / 

. ' ' ... - ", ' ■■ *> L> 

Such,a procedural paradigqj is fine if one is interested in the effects of 
mental review, but that is a far different situation than the , one encountered in ' 
practical settings, where students study freely with, their textbooks. There are, 
it. is true, some settings such as -in computer-managed instruction (cf. for .fn stance, 

• r » 

• Anderson, .et. .al . 1 97^)* where review is explicitly prevented, 'but these are rela- 
tively specialized settings, quite unr$pres$ntat i ve* bf natural study settings/ 

Jk. _ * • r» • ~ 

Furthermore, *the ecology of these specialized settings give.th^ postquestions the* 
character of a quiz rather than one of a set of learning aids. * ' 
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An anecdote from anothej area of instructional psychology illustrates how 

taskUonstraints can readi ly influence outcomes and^modify the ecology bf the 

setting. Anderson and his colleagues (cf. Anderson, 1970) .asked why it was 

that the provision of prompts in programmed instruction sometimes hindered 

learning rather than facilitate it', as was certainly the expected outcome. 'What 

they found was that their particular program inadvertantly enab-led the students 

to answer the questions by directly going to the prompted information without 

fully processing the frame. It was not that their students were cheati ng , but 

rather that they were going through the text In a different way than expected. 

They were simply processing the text differently. A similar situation would seem 

to prevail in mathemagenic research: experimental cons tra i nts encourage students 

4 to process the text in ways which are an exageration of th&'r natura 1 (^ones . 

-There is 1 i ttle' empi rical analyses at the appropriate level of the reading 

strategies adopted by students as they process a prose passage. In one of tf\e. 

few such studies, Thomas and Augstein (1972) found that effective reading strateg 

could involve the students in frequent 'returns to earlier segments of text in 

order* to'check or complete their understanding of particular points.. This is* 

exactly the type of text processing which inserted post-questions can be expected 

to favor when encountered in natural settings. 

To my koowledge, relatively few researchers 'have conducted mathemagenic 

research where physical review of the material was permitted after the'student 

t • 
encountered a post-question. Washburne (1929), Gustafson andjoole (1970), and 

Hi Her (197*0 havj* done so and their results would le^d one to view the issue of 

extrapolation to practical sett ings wfth some diffidence. These researchers 

allowed their stjbjecjt* to adopt a free reading strategy by enabling review x>'f 

prior material after encountering inserted post-questions. In all three studies, 

post-questions general ly. fa i led to enhance incidental . learning, ^ they usually 



do with the traditional but less naturalistic paradigm, and in some conditions 
of the Washburne and Hi Her studies, incidental learning was even depressed. In 
_ these studies then, po$t-quest i ons woulji seem to have shaped a selective learning 

i 

strategy, whereby attention is focused primarily on question-related content, 
sometimes to the detriment of other content. * 

. . Part of the problem is that mathemageh^cs, as they are operational i zed. in 
current research, are attractive t-o reseaj-chers for their practicality in terms 
of procedural design. Frase has noted before (1973). the force which an emerging 
methodology can have in molding a relatively rtew-field. |The result seems to be 
that mathemagenics have become established as a ; specia 1 i zdjd field of research of 
intrinsic interest of itself and eventually more'.and more lemote from practical,. 

\ ' 

considerations. This reflects the fate of many issues in the history of psychology 
and is q^iite understandable in terms of the traditional tradfe-off of external 

. • ■ ■ . - ♦ v - . i - * ' 

val idi ty for tighter experimental control (Campbell Stan 1$jL 1963) . This * ^ 

unfortunately is the price 7 which must often be paid to order \d guarantee strong 

internal validity. It also reflects, I would think, a^acit \\\ef in a para- 

digmatic view of educational progress in terms of beaps*»and fcoiiids through which 

«s • V '' ' • \ \ 

conclusion-oriented research, as the mathemagen ic research kan ceVta i n 1 y Be 

characterized, informs- practical decisions in an indirect albeit Jtrong way 

(Cronbach & Suppes, 1963). however, -as the earl i'er quotat ion J f fom\ Kintsch would' 

suggest, a given field- of enquiry can' become so narrow as to lose much of -i ts 

potential impact in terms of itsOeventuaj Applicability to real, 'S.ett i ngs . As 

he also states, 1 'expj ana t ions! are proposed for particular experiments, not for 

the questior>that at one^point motivated the experiments" (197*4-, pWd). ^ 

1 . f ' 

\\ * 

Mathemagenic Processing *, l , 

' . - * 

An interesting 'aspect of the mathsmagenic problem,' if it can^ be.'ca 1 led that, 
lies in the recent shift into a cognitive framework of explanation, which is 
evident m educational psycho logyVnera lly , as in more "fundamen'ta 1 verbal 



* * 

learning' psychology /as well. Indeed,, the modeling of processses has become 

• mor e prominent in mathemagenics, as elsewhere over the years. Rickards (1979) 

has- recently reviewed this area to show how four di stinct^processes can be 

invoked in order to interpret the ma themagenic* effects of postquestions. These 

, haye been demonstrated to have both a* backward effect, (i.e., on what has just 

^been read, but which cannot be re-examined) and a forward effect, (i.e., on, 

what will be read). Botfvef fects , furthermore, can either be specific in 
\ . • 

nature (question related) or general (unrelated to the questions). * 
v 1 . " 

It is the general forward effect of post-questions which had been initially 

called attention to by Rot^kopf and which has brought about much of the subsequent 

interest in inserted questions. An interpretation of this effect is that the 

provision of post-questions shapes the student's inspection behaviors, such 

, that he or^she will tend to gradually engage in more caref u 1 i nspect i on of 

subsequent segments of the prose passage. This effect is borne out by the 

research which has'employed the classic procedural paradigm described earlier 

(cf. the Rickards review, J979). ' It is, however, not borne out by the three 

Si 

studies WriVioned earlier which have allowed review of the prior material. Fur- 
thermore, an intuitive consideration of natural study settings would lead one, to 
believe that such-a process would not likely be very strong in such'setti ngs . 
The basic problem than is again the procedural one: prevention of back-tracking 
arti f icial izes the student's reading strategies. 

^Thus, mental review and the general stimulatory N ef feet of post-questions 
are both "con founded by procedural tactics. Jt could only be difficulty argued, 
however, that these two processes' are merel y s qu i-rks of the procedural paradigm • 
currently govern i ng^ma themagen i c research. We just dp not know what rmportance 
(or what |.itt1e importance) to give to these processes*in practical settings. ^ I 
have indicated elsewhere (Duchastel , 1979) that the mathemagenic literature can 

f 

be usefully interpreted mainly i a terms of a selective learning process, with 
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relatively little importance accorded to other processes. In the*past^ 
seem to have considered all processes as somewhat of equal 'importance. There- 
is no need to continue doing so, however, especially if we take the procedural 

constraints of the field into account, # • t I 

*• ' 

Research, Strategies ± 

The field of mathemagenic research can be considered f rd^ d i f f erent per- ' 
m "'spectives. The first of these could be' called the pure mathemageni cs view, 

for it construes mathemagen i cs as being not directly concerned wTth instructional 
practice, but rather with the, exploration of more general issues iTl the psychology 
of learning (Frase, 1973). This may seem perfectly laudable within a given frame 1 
work; however, it is well worth remembering that psychology itself is littered » 
with theories, and research on learning .which prove a constant disappointment ' 
outside of academia because they either fail to mirror re'al 1 i.fe "settings or else 
y^hey mirror relatively trivial oh*s. A psychology of the arti^f-cial is a luxury 
which we can only difficultly continue to afford. Frase (1973) himself has hinted 
, at the potential dangers involved with such an approach. * ( 

Another perspective which can be adopted "in interpreting the mathemagenic 
literature could be called the forced mathemagenic. view. This view recognizes 
that certain processes may perhaps only play a jiinim^l role jn 'real settings. 
Furthermore, it is precisely because of .this s|:ate of affairs that thes ? processes 
need to be bolstered or ''forced 11 ; otherwise, they TrTay not be,amenable to investi- 
gation at all. This is not all that uncommon in science. For instance, in biology, 
cells are often stained before being examined under the electron microscope-/ 
whether this radically alters what one then sees and ftfers/ from the investigations 
is currently a qiiestion of debate (cf. for instance, the provocative article by 

Hillman and Sartory, 1977). Forcing techniques are also, current in other areas 

? 

of prose -learning (cf. for instance, Dooling & Chr i st i aansen , 1977,j'p. 7). The* " 
great danger with this view, however, because of its subtlety especially, is that 

ERIC I ^ 7 Jio 



the forcing is eventually forgotten and goes unrecognized.' Untempered extrapoi i t ion 
then becomes al t l too easy. 

A third perspective 'is the ecological ly' val id one, where, experimental con- 
straints mirror as closely as possible natural text handling strategies. The 
study by^Gustaf|on and Toole (1970) is prototypical of 'this approach. 

- In sum, of the -three ways of approaching mathemagenics, the practical alter- 

native has been rarely considered, while the remaining two (the pure and the 

• * * 
* * 

forced approaches) have possibly fallen in the trap of running away with themselves. 

• . . . e 

; Where' to from here? 

^Both Rothkopf (1973) and Frase (1973) have opened the dialogue concerning 

thes.e issues and the main purpose of the present paper is to further attempt an 

S 

open discussion of these important themes. If I am right in thinking that'the 
procedural paradigm currently employed in mathemagenic research will not provide 
■ us with useful and practical results', then it is time we reassess' what we -feel- about 

'the field and broaden the scope o'f our investigations to include procedures which 

* '. r 
% more directly reflect rea 1 .learn i ng contexts. * 

However^one-must not be bitter about the deficiencies of the past and overlook 
the com'ributibn which this area of research has- made to the'field<of instructional 
psychology as a whole. Ma themagen ics^ research has indeed not only renewed the 
interest of educa'tors in questions, but it has also put in more than- its fair share 
\ in assisting the paradigmatic shift we have recently witnessed in psychology 'towards 
„ a cognitive perspective of learning. 

A greater concern for what ^mathemagenics are especially good at ^cf. Andersbn 
and Biddle, '1975) would,' I am sure, be especially useful in the future. For j'ns tance, 
the direct effe'ct of questions in enhancing the learning of question-related 
passage content- pan be substantia^!. Also, the process of selective learning '(the 
. focusing of learning through the provision of. inserted questions) needs to be explored 

S. ' i 

• ' - J , < ■ 
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much further to find out when and how it can be optimized, especially in Velat 
to complex high-level* types of Learning, Finally interest" in the related area * 
t df posttesting effects (obtained through the prov-ision of quizzes administered * 
after learning) could profitably be renewed for their practical -potential would 
m /seem even greater than that of inserted questions and remains relatively untaped ' 
(cf. Anderson and Biddle, 1975) V * - , ' > 

The main argument developed in this paper, however, has simply been that we 

• . ' - ( 
. need to stop assuming that all of the post-question research findings reported 

in. the I i terature 'can realistically inform instructional practice and, textbook 

design, Th*i£ Is an assumption which continues to be made by most reviewers of * 

the field (ppe notable exception i s ki ckahds , x 1 979) 2 • That post-questions do — 

* * ' 

enhance learning in real study settings is generally recognized. - However, ho# s 
theydo itjfand how questions c^n be taken. best advantage of remains to be 
established* 1 1^ is my hope that researchers interested in mathemageni cs wi^ 
become aware of the problem and design future studies so as to seek solutions 
* which can'b'e of relevance pedagogical ly. * . 



FOOTNOTE 



WKile the. term ma^hemage.n ics covers a whole host of adjunct aids, I shall 
^g^e it here in a restricted sense to cover only adjunct questions. 
. Melton (1978) also discusses 'this issue in a paper comparing research on 

behavioral objectives to research on adjunct questions. 
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Postscript : # s 

Adjunct Questions in Naturalistic Settings 

Note: Since writing -this critique of the mathemagenic literature ' 
(about a year ago or so), I have had occasion to reflect further 
on the problem it raises for the research community and on whqi 
line of research may prove promising .in the future. Discussion 
of the problem in a research seminar at the American College 1 has 
also been enlightening in speculating about processes underlying 
the use of adjunct questions in text processing. This postcript is 
meant to reflect these thoughts and speculations. 

The principal issue raised in the pap^r is the apparant lack of 
external validity "of most of the research on adjunct questions in textJ^w 
The basic argument is that students in real educational settings sfmply 
do not study their textbooks in the same way that subjects in laboratory 
experiments do. It is not the difference in environment per se which 
causes the* d i screpancy , but rather it is the difference in task orienta- 
• tion. In the usual adjunct question experiment, the student is not allowed 
to backtract; whereas, in real academic settings, it is plausible to think 
that he or she will normally backtrack. 

We currently know very little abdut w£at student^, in. fact/ do while 
studying texts and even less abput what they would doiwith texts incorpora^ 
ting adjunct questions. Hence, th*e speculative nature of the argumeht. ' 
Speculation is often seen as ungrounded, and by sdra as not a serious 
base on which to rest an argument. This I believe to be a serious mistake M 
for speculation can and should bean i >> [^^ r ' al part of any 4 sci ent i f i c dis- U 
course'. Empirical data are only one aspect of the investigation of a 
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phenomenon, and interpretation (which involves speculation) is really 

* , \ 

f the crux of the matter. 

. it is interesting, therefore, to consider the^ processes which may 

be operative in tbe-ijse.of adjunct questions. This is, pf course, af 

this time very speculative, but I believe i t -to be important., if only 

to map out certain assumptions, thus opening them up for further con- 

sideration and critique. What processes might occur then in learning 

situations Which involve adjunct questions? Or to put it in more col lo- 

t qu\aJ terms*, what goes' on in a students mind when he or s ; he encounters 

adjunct questions in a text? 

There is really l i tt le concern with pre-questions , i.ew, questions 

appearing Irvthe text before th'e paragraphs to which they relate. In 

encountering a pre-question, the student probably simply makes a mental 

note of it and continues reading the, text. When he or she encounters 

the particular information related to the question, that i nformati on is 

then probably processed at a deeper level than it would be otherwise. 

The student pays more attention to the item and possibly rehearses it 

mentally if the item is a factual item.' The pre-question thus sefk/es 

an orienting role—it labels some information to come as being particularly 

K 

important and, therefore, especially r.etent ion-worthy. Jhe learning of 

*** 

information not related to the prerques t ion ( i nci den ta l learning 2 ) is 

possibly not affected by the question, i.e., it is processed to the same 
■ » 
extent as it would be if the text had no questions (this is the usual 

research finding), At times, though, it may be that a pre-question 

focuses text processing to such an extent that incidental learning may 

in fact be adversely affected, as is often the case with the use of 

learning' objectives. 
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Our real concern is with the processes which*, might be activated 
by inserted posthquestions.' Cons ider^ the usual experimental situation, 
where the student is prohibited from looking % back at the information item 
related. to a postrquest ion he or she encounters. . What happens? Let me 
speculate. If the. question is an easy one, the student probably just 
answers it mentally and reads on. If the question," cm the other hand, 
is at all difficulty the student probably pauses and' -tries to mentally 
recap what was justlread, searching his immediate memory for an answer. 
If the answer is found, the student's later, retention of it will be 
strengthened. The mental search through memory might also strengthen 
learning of incidental information surrounding the item sought after**^ 

Let me turn now to the most -interesting mathemagenic effect, the 
effect of post-quest i6ns on subsequent text processi ng. Th*is involves 
an increase in incidental learning ascrfWj t\ the gradual shaping of 
a deeper text processing on the part of the student. The interpretation 
makes sense: I fsthe student encounters post-questions, which he or she has 
trouble in answering, a likely strategy would be for the student to slow 
down and process better the information which is being read. For the 
student knows that there will be further questions and he or she would lik 
to be able to answer therrt. As Rothkopf* has justly stated, "mathemagenic 

activities aVe adaptive . . . they can m be altered by their consequences 11 

/■ 

(1970). , 

♦ 

That -is so, but as was argued in the paper, only inasmuch as the 4 
student is not permitted to backtrack! Consider now the student in a 
naturalistic setting (say a college student reading a textbook) who en- 
counters a post-question in his. text. In this situation he can review at 
will. What is likely t^happen? An easy question will simply get a quick 



v * 
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mental response. A difficult question will probably elicit an attempt ' 
to mentally recap what was read, with a concomittant potential increase 
in incidental learning and a strengthening of the answer as well if 
it is found. If the answer is not forthcoming from memory, the student/ 
will most probably backtrack and seek it out in the text". 3 The- informa- ' 
tion related to the question will in either case be^.better processed than 
ft would have been otherwise. The degree to which incidental information 
will be more deeply processed will most probably depend on how hard the 
student mentally searches for the answer to the post-question before 
giving ^jp and seeking it out in the text. The nature of this search 

(mental only versus mental and physica.1), therefore, cons* i tutes 'the f i rst 

s 

prcfcess t difference between the usual experimental situation and the 
natural istic one. * 

£he crucial difference, however, relates to 'the'adapti ve na.ture'of 
mathemagenic activities. InU natural sett i rig , - wi 1 J post-questions gradual 
shape deeper text-processing strategies?* I" believe the anW to be no % 
Why^not? -Quite simply because th^re is little challenge in it\for the 
student. He knows, of course, that further questions' wi 1 1* be encountered 

4 

but he also knows that if he gets stuck, he will be able^to backtrack and 
find the answer.- There should, therefore, be 1 i ttle concern for him to*, 
make the extra effort to process the text more deeply ,7 and hence more 
slowly if not alsoN^ipre arduously, incidental learning should, therefore,^ 
be no more increased than in a situation without post-questions. At least, 
not because of any shaping phenomenon. - 

It is here in this Strategy trade-off that I believe we find the real 
difference between the experimental research ^nd natural istic -studying. In 
the latter setting, post-questions can actually become pre-qifes t ions , at 
least pVe-ques Lions to a physical review of the paragraphs related to them. 
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This indeed is v essent ial ly why researchers have instituted the unnatural 
prohibition to backtrack. The consequence of this, of course, is that 
their results may be due in a large measure to this exper imenta I artifact, 
and not as generally supposed to any^shaping process of the reading 
strategics of the students. ' , * • 

Once again, the analysis of mathemagen i cs #jus t described is highly 
speculative. If the' reader agrees wi th its logic, however, there should 
be some concern over the course of this research endeavor in terms of its 
pedagog4ca I appl icabi I i ty. 

.1 believe the area of questionning during reading to be a highly 
important one, one which, needs to be reconceptua 1 i zed as it were, as well 
as being further subjected to empirical scrutiny. While the type of 
research needed may be difficult to undertake, since naturalistic reading 
. is such a private process, the ecological imperati ve stjould' a lways form 
part of .the framework of such research. It is only then that we shall 
find applicable answers to real problems. 
The ecology of question usage . r '* 

• / What I have considered above are possible (3nd plausible) processing 
strateg ies£ which a learner mi^ght typically engage in upon encountering 
inserted questions in text.' It would slso be profitable in examining 
this issue to consider practicalities of using questions as* instructional 

n^ 

inserted questions^ in a way which parallels their use in the prose passages 
employed in research. 

To be sure, many textbooks employ questions^ as adjunct learning aids. 
However, these ar<= usually not 'inserted in the prose text .itself, but 
rather they appear at the end of chapters. This question usage thus 



20 



aids, i.e., to examine the issue from the perspective of the i ns tructiona ! 
designer. After all, very few instructional texts actually make use of 



constitutes a rather different ecojogy than the one involved in the 
mqthemagenic situation. It gives the questions the character of a 
quiz, or that of review exercises. It is, doubtful that such question 
usage would have any shaping effect jn „terms of subsequent text pro- 



cessi ng. ^ % 



Another situation in which questions «are common ly- used is in study 

* * • * 

guides which, accompany textbooks'. .This, in fact, is*merely another variant 

of the questions-at-end-of chapter form of instructional design^ith the 

same ecology as this latter usage. *1 

One^area in which questions^re often interspersed in text is in 

distance-teaching materials. The/Open Un i vejrs i-ty i n Britain, which 

prepares all of its own instructional materials, makes heavy use of inse«%d 

post-questions, which it calls Self-Assessment Questions (SAQs)\ The* 

student is requested 'to men ta 1 ly*ton struct an answer to them before seeking 

confirmation as to its correctness. The distinquishfng feature- tif these 

questions, however, and 4 that which sets them apart ecologically from ' 

mathemagenic questions, ils the -fact that o answers to these SAQs generally 

appear at the end 6 of the text. The student, therefore,- need not return . 

V 

to the text .to search out an answer. ft is doubtful, furthermore, 5 for 
reasons discussed below^, that subsequent text processing is shaped bp 

the consequences of-#is or ker question-answering. 

- t 
Let us consider processing once again, this time in terms of a 

functional analysis of adjunct questions.- * Xhe current concept of com- 

prehension i morn toring can be.made good use of here* 5 The express purpose' 

of Self-Assessment Questions is to give the student* an opportunity to 7 

monitor hi) or her comprehension of the text, 3** .if it is found wanting, 

to reprocess those parts of it whjch may need it. The same function is 

served by end-of-chapter questions and by study guide jquest ions The aim 



is to lead the student to process more deeply those parts of the text 
which were not sufficiently processed io» the. first reading of the text. 
The direction of processing i s* thus ' retroact i ve, and not proactive (i.e., 
' it is a question of £e-process i ng rather than one of deeper processing 
Of subsequent material). * • - ^ . . 

Now it may seem plausibje that a studenV-Who is not able to answer, 
many of the inserted questions he or she- encounters wil Ureal ize that he 

* . *' * 

or she is simply going toq fast /i.e., not processing the text deeply 
enough). -This, in turn, may lead the student tp^slow down and thus better 
* process subsequent textual material. This may* be the case to some extent 
(which would somewhat vindicate the mathemagenic approach)', although I 
believe it to be largely unhike*ly. f r ' ' % 

To understand why/, we 'need ^to* now consider the issue from yet another 
perspective, that of t*he student. We need to examine task orientation from 
th§ student's point of view and thus -cons ider the ecology of studying. 
College students study rather di f ferently v than school children though, 
sofye,>need to. examine each ir^ turn.- - r 

Consider the col lege 'student studying a textbook for one of his or 

j - 

her courses. What' influences impinge upon his or her study behavior?* For, 
one, there is the desire to succeed, i.e., to master the material in the 

* '# 

text.^ This orientation should lead to deep processing,, to good compre- > 
hension monitoring, and to slower and "deeper pYoces sing of subsequent 
material if m6nit9ring reveals inadequate pr&e£§sing: However, thefe is 

another big influence" on study behavior which can severely limit this 

** * 

first orientation, namely the constraint of time. Study timers usually 
in short supply for the col lege' stbttent knd he or she Will oTten adopt the 
easiest -or quickest strategy of text, processing 'in order to master the 
material. What would this-strategylikeTy\be? Probably an^ini tial pro- 
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cessing of the text, followed by comprehension monitoring through adjunct 
questions, followed by making-up for misunderstood information on the basis " 
of the monitoring. In other words, it is simply easier (and more efficient' 
from the student's perspective) to process jthe text lightly initially and 
then to «go back to it afterwards if need be, than it would be to process 
■» the text more deephy. When time is .scarce,' deep processing becomes a 
• luxury which" the student may well feel heSr sL cannot afford. Thus, 
the math'emagenic shaping of deeper' processing \j/ould seem like a theoretical 
ideal, although one which is'probably not realfzfed in practice (other than 
in artificial experimental 'si tuations as'*was. argued\ in the paper). 6 

What about the schooj^ child who is studying a text in ciass. Here 
the time constraint is presumably negligable. It may, therefore, be 
possible that adjunct questions would lead to deeper subsequefit processing. 
~t> doubt it, however, for school children are poor monitors of their com-' 
prehension and probably even poorer strategists: I would guess that if 
they did use the adjunct questions to monitor tihei r. under'standi ng, they . 
would follow the same strategy as that of the older student, i.e., repro- 
cess unlearned parts o*f text -as needed. 

Is there not a typcial s.tudent, though, say in jurrior high school, 
whoynay study in an ideal manner, i.e., adapt his or her text processing * 
depth of subsequent text as a function of 'comprehens ion monitoring? Possibly, 
although I doubt this type of student would, in fact," be very common.' 

We are, therefore, left with the following conclusion: what seemed 
like a- good idea on theoretical grounds (the shaping "of depth of proceWing)> 



'may well be very impractical in real educational settings. 
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Designing adjunctjiquestibns . 

While the tone of the paper, "as well as that of this postscript, 
is very critical of mathemagenic research, it must not be*inferred that , 
,^we should disdain the use of questions in text: Quite to the contrary. 
It is the theoretical interpretation and its under ly i rig .procedura 1 para- 
digm that I am disagreeing with, not the use of questions as learning aids* 

w Interest in adjunct questions has .largely been due to 'their indirect 
effects as revealed in the research, i.e., to their potential to enhance 
incidental learning! Thei r di rect effects (enhancement of question-related 
learning) are taken for granted, as indeed' they should be.' The case I have 
argue^in the paper is that we should seriously question our curnent v bel ief 
that we have happened upon this exciting new way to genef^l ly enhance 
learning, as opposed to enhancing it only selectively/ In other^ords, 
the use of adjunct questions in real settings probably wou^d not enhance 
incidental, learning. This point of^view is generally not recognized in 
the research community and we continue to marvel at the ind i rect^ef fects 
of questions. 

J believe there is a fundamental rjisconcep,tiVn here concerning the 
design of adjunct aids for use in instructional materials. The conception 
^ seems to be that if only a sampling of the ideas ^n^a- text are questioned, ' 

we will nevertheless enhance the learning of many of the other ideas as 

* > 
well, in addition to that of the questioned ideas. Anderson and Biddle 

(1975) speak of the importance of the indirect effects in these terms, as 

did Rothkopf in his seminal paper in the area (1970) . m But why. sample? 

'Why nat question those ideas which we feel are essential for the student 

to remember and let him forget the rest? 

That may sound like a harsh statement . . . "forget the rest". It 

does not sound like anything one would recommend if the goal were to optimize 
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learni-ng in a given situation. That is trOe if we view learning, as we 
ofterjdo, as the accumulation of knowledge/ and indeed as the accumulation" 
of as much of it as is possible. I would suggest that this view is limited. 7 
The student is not some kind of storage b i f\ to be filled up with all the 
information we present to him or her in a text. A better view is that of 
learning-as a selective accumulation of reformation. In other words, we 
would like the student to retain the main points. pf a text, or the facts 
that we otherwise judge to be important." We really Want him or her to 
selectively'process the \^foynat ion in a text. Unselective deeper pro- 
cessing thus becomes non-opt\mal especially when we consider the 'c^n^tra i nts^ 
of time, as we always must. 

It is essentially for selective processing purposes that we provide 
students with learning objectives (when we do so). It should also be for ' 
that reason that we provide students K wi th adjunct questions, fi^th ©bjec- . 
tives and inserted questions cue the student as to what to concentrate 
on, i.e., what to process deeply. 

If we accept this selective processing view of optimizing learning 
in real settings, the enhancement of incidental learning fully loses its 
perceived importance-- iryfact \ t becomes detrimental.^ It becomes detri- 
mental when we View the student, as an individual with some finite capacity 
witlfFn some finite time. Within some* period of time, we could have a 
student *fearn everything in a text (essentia] elements and incidental ones 
as well), or we could have him or her learn only the essential elements ~ 
within the text and then learn the" essentia 1 .elements in another text. 
Teaching is selective, and so must be learning. 

The jnstructiooal designer must thus decide which points in a text 
sre the .most important ones and then he should question those. Adjunct 
questions should have direct effects, not* indirect ones 
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Research Avenues * \ 



wa 
t 



— ~ Given that most of the past research on inserted questions is sUspect 
in terms of its applicability in real academic sett i ngs>c*id given that 
research on questions in texbvU an important research problem, what 
direction should £hjs research take? A number of pd?si bi li tfes a(e open . 
to US . . 

* . , - V" ' 

\ * 

s » r 

-One tempting approaches to examine the .eco log /ca 1 problem discussed 
in the paper directly. This would involve an experimental comparison of ' 
post-quest i,on effects .under the traditional constraints (no backtracking.^ 
permitted) and <undec more natura 1* constraints (backtracking permitted). • 
•The hypothesis to be tested would be that matherriagenic effects (enhancement 
'of incidental learning) would occur in the first condition, but not in the 
second. A study along these tines which" I conducted myself some months' ago 
was .unsuccessful , possibly due to a lack of experimental 'control'. The . 

tudy failed to find mathemagenic effects i'n\eithe.r condition and no Com- 
parison can 'therefore be made. 8 The case, therefore, remains to be made 
■ empirically. . Such /aTstudy would certainly inform the main issue discussed 
in the paper (by either supporting the argument or contradicting it). 

Another research approach, one which ia much more important I 
*feel, is to examine reading and s^y behaviors of students as they process 
text. The challenge, of course, is to 'devise ways in which this can be^ 
done unobtrusively, without disturbing or artificial i^mg fhe processes , ' 
being examined. We need to find out how student*; actually go about pro^ 
ces*>ing text, what they, do when they encounter an inserted question, and 
soon. Attempts in this direction appear to be few -and still relatively ' -* 
unsophisticated. Devices whi^h monitof a student's reading activity, such" 
as the reading recorder developed ""in Britain (Thomas and Augstein, 1972;* 
Whal^^and Fleming, 1975) may show promise if further developed. Computer 

\ \ m /* % ^ 
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presentation of text on a video terminal may also be appropriate (e.g., •/ 
Alessi, Anderson, and Goetz, 1979), as might also be eye-movement moni- 
tors. The task before us is to find ways to monitor reading activities 
without drastically changing- the ecology^ of^the situation. 

Yet another approach is to get studertt reactions to their use*6f 
questions in text. This could be done either through surveys or debrie/ing 
interviews following reading. Examples of the survey approach are studies 
by Nathenson (1978) and Duchastel and Wh|tef*ad (1979), which attempted to 
find out the extent to whjch Open University students in Britain actually 
made use of the Self-Assessment Questions they encountered ,i n their texts. 
The danger of this approach, of course, is "that students may not themselves 
in fact know what they do, even though *they may feel that they do know. % 
Examining one's own reading strategies is a demanding task. I, neverthe- 
less, -feel that getting the student's view should be an important aspect 
of the research on questions. Not only what a..student does, but why he or 
she does it, can certainly assist in helping us explain what, is going on 
during reading.^ • ^ 

In conclusion, the rigorous approach which constitutes the experimental 
studies of adjunct questions needs to be complemented by the less reliable 
but more insightful one offered by observation. and analysis. The mis- 
direction ofadjunct question research discussed in the paper would seem to 1 
certainly Support such a view. 

Finally, we need to further critically review the assumptions about 
learning which underpin our research strategies. If a view of learning 
as selective 'processing is favored, then we'should perhaps emphasize research 
on the direct effects of questions (as Anderson and Biddle, 1975, have done)' 
and be 1 ess -concerned* wi th their indirect effects. 



Postscript footnotes: 

1. The initial paper was written While I was at the Open University in 
Great Bri tain. 

2. Incidental learning is a technical term commonly used to refer to the 
learning of information not^ related to an adjunct aid such as a learning 
objective or an adjunct question. Its incidental status is only tech- 
nically ascribed and need not correspond to a lower level of actual im- 
portance in the text. This issue is explored later on' in the postscript. 

3. An assumption made here, of course, is that the question i's perceived 
as important, otherwise it will simply be skipped, and not recalled 
later on. 

Jr. It also sometimes makes use of what are labelled In-Text Questions (iTQs). 

These are generally questions which either expand pn the subject matter ar* 

* • . * v 

attempt to .increase student motivation by getting the student to think 

out some problem prior to the discussion of it in the text. They, there- 

fore, share some of the character of pre-questions , although they are 

^ 

probably better thought of as rhetorical questions which are explicitly 
labelled. 

5. Rehearsal monitoring is another form of monitoring where the information, 
to be learned is factual informatiorr. The present analysis applies to - 
both comprehension^and rehearsal monitoring, although I shall refer 
solely to the foVmer in this discussion for the sake of brevity. 

6. The situation would be even further complicated if we considered other 
influences on study behavior, sudh as" interest in the topic, the perceived 

* relevance of the questions, etc* 

7. The parallel to the idea of sampling in test .construction is evident 
here, the conception works fine in testing (within limits), but not 
wel 1 in learning. 

^ ***** 
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The repor.t of this study, entitled Mathemageni cs and Review Constraints, 
is available in mimeograph form from the author. ' . 
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